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^SJ Abstract. In this paper we consider central limit theorems for various macroscopic ob- 

— I servables in the high temperature region of the Sherrington-Kirkpatrick spin glass model. 

^ With a particular focus on obtaining a quenched central limit theorem for the energy den- 

K-j sity of the system with non-zero external field, we show how to combine the mean field 

J cavity method with Stein's method in the quenched regime. The result for the energy 

density extends the corresponding result of Comets and Neveu in the case of zero exter- 
nal field. 

ri 1. Introduction 

^ The study of mean field disordered systems has lately seen much interest from the 

Ch theoretical probability and (mathematical) statistical physics communities. In this paper 

we reinvestigate the general problem of proving central limit theorems for macroscopic 
CN observables in such systems. For a reasonable family of models, the book |19| shows 

^ how to obtain such theorems in a direct way, by computing all limiting moments of the 

random variables in question (in particular we refer to Sections 2.5, 2.6, 2.7, 3.5, 3.6 and 
CN 5.10). Vaguely, the method rests on having a priori control of some fundamental order 

^ parameter (in the high temperature regime). 

O For the specific model we consider here, the Sherrington-Kirkpatrick model [151 , among 

^ the notable rigorous contributions we mention EUSJUI [iTl [l2l 13 [lOl [HI, culminating in 

the verification of the Parisi formula [201 . The SK model is defined via the Gibbs mea- 
sure on spin configurations cr G := {—1, 1}^ with mean field interaction given by 
the Hamiltonian 

1 ^ 

^ 1<!<;<N V N ,-^1 

The couplings gi^j are assumed to be independent Gaussian variables with mean and 
variance 1; G R denotes the strength of the external field. In other words, each spin 
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configuration a G is chosen with probability 

The parameter /B denotes the inverse temperature and note that we have omitted the 
minus sign from the exponent for convenience. 

In the case of the Sherrington-Kirkpatrick model, the role of the order parameter men- 
tioned in the first paragraph is played by the overlap R\X- Let a^, G { — 1, 1}^ denote 
a pair of spin configurations. The overlap between a^, is given by 

Control of Ri^2 is obtained by relating the full system of N spins to a system in which 
one of the particles has been decoupled from the other N — 1 in a 'smart' way via the 
cavity method. Among other consequences, the cavity method allows the explicit com- 
putation of all moments for Ri 2 when properly centered and scaled, and thus proves 
quenched and "quenched average" CLTs for Ri^2 via the method of moments (for a def- 



inition of quenched and quenched average, see Section 1.1 1. 

Our goal in the present work is two fold: First, from a specific viewpoint, we explore 
the limiting behavior of 

2 N 

l<i<j<N V-N !=l 

under the quenched and "quenched averaged" Gibbs distributions. In the h = case, 
this problem was studied previously by Comets and Neveu in the beautiful work |6| and 
later was re-derived using Stein's method in |^. Let us recall for the reader the relevant 
result: 

Proposition 1.1 (Proposition 5.2 of JSl) Let h = and /6 < 1. Then as N ^ co, the law of 

Hn := (N - l)-2 [Hn((7) - (N - l)|6/2] (1.1) 
under the quenched Gibbs probability distribution weakly converges in probability to the law of 
a centered Gaussian with variance ^. More precisely, we have 

lim {exp[^nN]) = exp(j62^V4) (1.2) 

for every real }i, where the convergence occurs in probability with respect to the i.i.d. Gaussian 
couplings. 

In a broader context, the present work may be seen as a test case for a general ap- 
proach which strengthens, unifies and extends the CLTs from ||T9| . In this respect, we 
address two issues: first, the 'method of moments' only provides distributional conver- 
gence in the weak sense (and no rate of convergence in any associated metric). Second, 
an inherent feature of this approach is that a CLT for any other macroscopic observable 
requires the computation of joint moments with overlaps, creating extra work each time 
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we consider some new observable. In particular, we point out that the condition for hav- 
ing central limit theorems for a variety of observables rests on the invertibility of a single 
matrix. It seems reasonable to believe our method extends to other systems, however 
below we limit considerations to the SK model. 

It is worthwhile to compare Proposition 1.1 to our main result. Theorem 1.5 below. 
First, our convergence result for the quenched average law of is in the stronger Wasser- 
stein distance as opposed to weak convergence (which is implicit in the above result). 
Also, as one can glean by a simple comparison of the general formulas for the quenched 
average and quenched variances a\ and Oq respectively, the h ^ Q case involves con- 
siderably more intricate computations. Note further that in general 7^ ctq, which 
is however the case iih = 0. Finally Proposition |1.1| implies that if /z = 0, then up to 
terms of the form o(N2), Tifq is centered under the quenched Gibbs state. The analogous 
statement for 7^ is not true. 

As a general rule, when h producing results for the SK model is harder than when 
h = (attention was brought to this fact by Talagrand in [18|). From a structural point of 
view, the difficulties associated with the case h may be summarized by the fact that 
under the quenched Gibbs state, the pair of overlaps Ri 2, ^2,3 are uncorrected when 
h = whereas this is not the case for h (even after subtracting off their common 
mean). 

The remainder of this paper is organized as follows. In the next subsection we intro- 
duce much of the notation and mention the interpolation we shall use explicitly. In addi- 
tion, we give a brief summary of Stein's Method, which is the main tool we use besides 
the cavity method. The reader wishing a more detailed introduction should consult HI. 
Section 1.3 gives a rundown of the explicit results appearing in the paper. In Section 2 
we review some technical facts from | (T9| and extend them to give our main estimate. 
Corollary |2.3[ In Section 3 we give a self contained proof of a quenched average CLT for 
the internal energy (i.e. the quadratic portion of Hj^). Sections 4 and 5 provide the proof 
of our main result. Finally, Section |6] contains a number of the calculations used in the 
rest of the paper. 



1.1 Notations. 

The consideration of quenched Gibbs states below provides a number of complications. 
First, measuring the size of a quenched average is most conveniently addressed through 
the concept of replicas: Let us fix a realization of {gi,]}- For each a G 

Hj(,(t7) = HMia'), with (7'' e En V 1 < r < n. 

The quenched Gibbs state corresponding is denoted by (■). We denote the n-replica 
quenched average Gibbs state by v ( • ) = E [ ( ■ ) ] . There should be no confusion here since 
both (■) and v define consistent families as n varies. 
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Let q2 denote the solution to the equation 

ij2 = E tanh^ + h) 

where z is a standard Gaussian random variable. A result due to Guerra fW] and Latala 
|13J shows that there is a unique solution for q2 whenever h > 0. We shall use the 
notation 

qp = E [tanh?^ {^^/qiz + h)] . (1.3) 
A fundamental result, due to Frohlich and Zegarlinski [8J without rates of conver- 
gence and Talagrand II18I with rates, is that for each G IR and at high enough tempera- 
ture. 



E 



(Ri,2 - qiY 



< 



c 

N 



for some constant C > as N, the number of spins in the system, tends to oo. In fact, we 
shall assume that {^,h) satisfies 

'{Ru-qif^ ' ^ 



E 



< 



N3 



(1.4) 



We remark that according to IIT9ll Section 2.5, there exists a /3o > independent of N, h 
so that ( |1.4| holds for all < /3 < /3o (actually much more was proved: If /3 < /3o, the 
random variable N (Ri,2 ~ ^2)'^ has finite exponential moments in a neighborhood of 0). 
Our study is facilitated by viewing Hn as composed of two terms 

Hn = £n + NhMN 

where 

1 



M 



N 



E 

l<i<j<N 
1 N 



7=1 



denote the internal energy and magnetization of the system respectively. Since we are 
interested in the fluctuations of these variables, it is convenient to define the normalized 
quantities 

"'^\l-ql), 



£n 


- ^ F ^ 


Mn 


= Vn [Mn - 


7^l,2 


= VN [Ri,2 - 




= £n + Mn- 



2 



Next let us review the cavity interpolation. Given the n-replica quenched average 
Gibbs measure v, we define the measure Vf as follows. Let {zr}"^^ denote a sequence of 
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standard Gaussian variables independent of the coupling constants {gi,j}i<i<i<N- Isolat- 
ing the last spin of each replica with the notation e*", let (•){ denote the quenched Gibbs 
state with Hamiltonian defined by 

\<r<n \<i<j<N-\ V iV 

Then we let 

!/((/) :=E[(/)^]. (1.5) 
In particular vq decouples the replica spins corresponding to the last site from the re- 
mainder of the spin system. We use the notation R^^, to denote Rfc ^/ — /N and 
extend this notation in an analogus manner to macroscopic variables such as Mn, M.n, 
En, Hn etc. 

An object of importance below are the local fields: for an index r G [n], define 

I 

As will become clear below, for the purposes of a quenched CLT, we will need to 
give an extension on the usual bounds for the Stein characterizing equation of a random 
vector. Let |jx||2 denote the Euclidean length of x G R-^" and let G{x) be a polynomial 
in the components of x with total degree d. Obviously, there exists a constant Cg > so 
that 



-G(x) 



<Cg (1 + ||x||2)' 



dX;, dXi 

for each m-tuple (z'l, . . . , /^), G W", the bound holding uniformly in m. Let (IR'^) de- 
note the set of functions f : ^ M. which are bounded and have one continuous 
derivative. Let = {f e C^(R) : /' is globally Lipschitz} and define a norm on T by 
11/11^ = ll/IU + II/' Hoc + Lipif). More generally let 

J^2„ = {f e CKe}") : VF is globally Lipschitz} . (1.6) 

Our case study will revolve around the vector 

X^^ = {£],,.. .£^,Ml„...,M'k) (1.7) 

where the superscript refers to the replica under consideration. 

Let F G and let G : IR.^" ^ R a multivariable polynomial. To keep track of the 
error dependence in our calculations, let us introduce the notation Er{F, G) to mean any 
term involving F and G which can be bounded above by 

\Er{F,G)\ < (1+ ||F||oo+ ||F'||oo + Lz>(VF)} x 

n C 



|i + Cgv((1 + ||A'«||2)'')'| 



Here and below, the constant C > will stand for a generic constant which may depend 
on the number of replicas n, the inverse temperature j6 and the external field h, but will 
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not depend on F, G or N. The value of this constant may (and will) change from line to 
line. 

For the convenience of the reader, let us sketch Stein's method (the reader may find a 
systematic introduction to the method in [4]). The method exploits two basic ideas. The 
first is that one can define distances between the distributions of random variables by 
optimizing over classes of test functions. In this paper for example, we use the Wasser- 
stein and Levy metrics. 

The other idea is that distributions satisfy 'functional identities' which can be used 
to characterize them. Let z,j denote a Gaussian with mean and variance t]^. The well 
known integration-by-parts identity for Gaussian variables says 

E [z^f (z,)] = //^E [f'(z^)] . (L8) 

Now, given a test function u, suppose we solve the ordinary differential equation 

xF{x)-ti^F'{x) = u{x)-E[u{z^)], 

then we obtain 

|E [u{X)] - E [u{zrj)] I = |E [XF(X) - r]^F'{X)] \ . 

Hence, if we can show that X approximately satisfies ( |1.8| l, this leads to bounds on the 
distance of the distribution of X to a Gaussian distribution in the appropriate sense. 

Before stating our main results, let us recall the definitions of the aforementioned 
metrics: Suppose X, Y are random variables on R with associated distributions fix, Vy 
and cumulative distribution functions Fx, Fy, we define the Wasserstein distance by 

Wi(x,y)= sup |e[m(x)] -E[M(y)]|. 

iM:R^Rs.t. I 

I £.!>(«) <l J 

Further, recall that weak-* convergence on the space of measures on R, when restricted 
to probability measures, is metrizable by the Levy metric p: 

|0(X,y) = inf{e > : Fx{x - e) - e < Fy(x) < fx(^ + e) + e for all x G R}. (1.9) 



1.2 Results. 

Let us begin by stating a CLT for Ejq under the quenched average measure v. The proof 
of this result provides a template we shall use in the more complicated setting below. 



Recall the definition of qp and v from Section 1.1 We use the notation 

fl=(l-<?2)' 

b =2q2 + qi — ^q^ 

c =1 — 6q2 — q2 + 6ij4. 



Let us define the standard deviation Ca by 

2 (l-,62fl)(l-^2c)+^4^2 



. _ 1 , ^q2{a-£{l + ac))_ 
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Theorem 1.2 Suppose that {p,h) satisfies the high temperature condition (1.4 1. Then for any 
function f E T, under the quenched average measure v 

An easy consequence of this result in combination with Stein's method is a bound on 
the Wasserstein distance from the law of 6n under v to a Gaussian random variable. 

Let us recall the basic result from the body of work known as Stein's Method which 
allows us to convert Theorem 1.2 into a CLT with quantitative bounds. 

Lemma 1.3 (See [4J) Let g : IR ^ R be a Lipschitz continuous function with Lipschitz 
constant L. Suppose that / : R ^ R solves the ordinary differential equation 

fix) - xf{x) = g{x) - E [^(2,=i)] . (1.11) 

Then 

||/IU<L, ,||/'||co< y^L, ||/"||oo<2L. (1.12) 

The last inequality is understood to mean that f is Lipschitz continuous with constant hounded 
bylL. 



Corollary 1.4 Suppose that (/3, h) satisfies the high temperature condition ( |1.4| |. Consider the 
random variable under the quenched average measure v. Let Zg-^ denote a normal random 
variable with mean and variance cr\. Then we have 

Remark 1 . Below (Theorem |1.5| we go further and derive a quenched average CLT for 
Hn, and use this information to obtain the behavior of the distribution for {Hn), for 
which, interestingly, a Stein characterizing equation does not seem easily accessible. 



Our strategy for the derivation of Theorem 1.2 runs roughly as follows: Through a 
combination of the cavity method and Gaussian integration by parts we reduce the 
identification of a functional identity between v [E^qf {£n)) with some scalar multiple 
of V (/' {£n)) to a characterization of the interaction between the overlap Ri^2 and the 
variable £n through the quantity 

(7^l,2/(^N)). 

Using the cavity method, we derive a pair of (approximate) linear equations involving 
this quantity and the pair 

^qiv {n2,3f {£n)) andt/(/'(£:N)). 

Solving these equations in terms of v {f'{S]^)) identifies the Stein characterizing equa- 
tion. 

Let us next formulate a summary of our main findings. Recall that weak convergence 
for the space of probability measures on R is metrizable via the Levy metric p ( |1.9| |. 
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Theorem 1.5 (The Full Picture) Suppose that {fi,h) satisfies the conditions of Theorem 1.6 
Then: 

(1) Consider the random variable under v. There exists a variance a\ depending only 
on (/3,/z) so that 



(2) Let denote the random var iable — {Hn) under the quenched Gibbs distribution. 
With Oq as below in Corollary 1.8 for all e > 



lim F{p{CN,ZaQ) >e)=0. 



(3) Finally consider the law of {Ti^) under the Gaussian probability measure. We have 

We next provide a brief sketch of what is to come, in particular regarding (|2]| of the 
previous theorem. 

Sketch of Quenched Central Limit Theorem: 
Recall the definition of ( |1.7[ |. To prove the quenched CLT, we proceed as follows. The 
main computational ingredient, stated below as Theorem |1.6| is to derive multivariable 
quenched average functional identities for the vector A"^. This derivation is an elabora- 
tion of Theorem |1.2[ Stein's Method bounds then give Corollary ] 1.7} which in particular 
implies an quenched average CLT for H^. 

Next, we use replicas to turn this set of quenched average functional identities into a 
quenched functional identity by replicating the spin system. By this we mean elaborate 
use of the following basic observation: Given a function / : K — > R, suppose we are in- 
terested in size of the quenched variance, {{fi'Hfq) — (/('^n)))^)- This is itself a random 
variable, but we may estimate it by taking expectations: 

Then we may always represent this expression in terms of a family of 6 replicas: 

E[((/(Wn)-(/(Wn)))Y] 

= y dmh) -f{nl,)){f{nh)-f{n%)){f{n%)-f{n'^)){f{n%) -f{n%)) 



This allows to employ the previously derived quenched average functional identities for 

The application of this idea to get bounds on the quenched Stein equation is stated 
as Corollary [L8j Part of the subtlety here is that under the quenched Gibbs state, Ti.^ is 
not centered. Moreover, it seems unclear how to derive functional identities directly for 
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the centered variable — (Hn) since (Hn) depends on the {gi,j} and ct" in a compli- 
cated way. Thus our quenched identity is stated in terms of a functional equation for a 
Gaussian variable shifted by the quenched mean {Hn)- 

This approach also leads to slight complications since the solution / to the Stein equa- 
tion 

xfix) - a^fix) - iif{x) = g{x) - E [g{az + ^)] (1.13) 
depends nonlinearly on ji,a (for us a is fixed, however). This problem is dealt with 
through Lemma 5.1 which may be of some independent interest. 

Finally, using the quenched average CLT for Ti^q and the quenched CLT for Ti,]^ (or 
equivalently H-m — {Hn)) and a characteristic function argument, we derive a CLT for 
the variable {Ti.^), which provides a fairly comprehensive picture of the fluctuations of 
the energy density at high temperatures (see Theorem |1.5[ |. This completes our sketch. 

Let us next formalize what is proved in the ensuing sections. To be precise, we require 
a bit of notation. Let 

Recall that under vq replicas associated to the final site decouple from the previous N — 1 
and so these entries can be expressed explicitly in terms of {l,(?2/'?4}/ depending only 
on the number of indices in common. 

Let 21 denote the ("2^) x ("2^) matrix indexed by the ordered pairs 1 < r < r' < 
n + 2, l<k<k'<n + 2 with entries 

f aiKk' ^1 ^ V ^ ^„ J ^ iJ 



21;;, r' <k' <norr' <k' = n + l, 

i"t')kf' k' <nj = n + l, 



-n^'ti k' <n,r' = n + l, 



K'Zl - + ^n'r'nXl k' = n + l,r' = n + l, 



-{n + l^Y+Xl+i + ("f )(^4 -ql) k' = n + l,r = n + l,r' = n + 2, 

l-ql-2{n + 2){q2- qj) + ("^^) (t?4 - ql) both pairs are {n + 1, n + 2}, 
otherwise (i.e. r < n, r' = n + 2). 

(1.14) 

Parenthetically, we remark that this matrix is closely related to the coefficients appearing 
in Lemma [Z2| Recall the definition of Tin ( |1.6| . For any F G Tin and any multi variable 
polynomial G : M.^" R, let GF{X{^) = G{XI^)F{XI^) 

To put into context the following result, recall that if ^ is a Gaussian vector on R"^ with 
covariance matrix C, then for any sufficiently regular F : R** ^ R, 

E[gF{g)] = C-B[VF{G)] (1.15) 



Theorem 1.6 Suppose that h) satisfies the high temperature condition \1A\ . Let j6 be small 
enough so that Id — fi^^ is invertible. Then there exists a positive semi-definite covariance matrix 



10 S. CHATTERJEE AND N. CRAWFORD 

£ : R2" ^ R2n ^^^^ 

V [e'GF {X^)) = e ■ 1/ (VGf (A-jiJ)),. + Er{F, G), (1.16) 

v(A1'Gf (A"^)) =e-i/(VGf (A';j))„+, + Er(F,G). (1.17) 

Remark 2. Implicit in the above theorem is the fact that €. arises as the limiting covariance 
matrix of the vector X^. This follows by specializing G to be one of the coordinate 
functions and F to be the constant function 1, however this is not how we identify G!. 
Also, it is worth noting that by exchangeability of replicas under v, the entries of 't take 
only 6 distinct values. 

Remark 3. Our condition on the invertibility of Id — j6^2l is a bit unsatisfying, but cer- 
tainly holds for ^ small enough (independent of h). We have not attempted to character- 
ize precisely invertibility. Qualitatively, the result is important, since one can envision 
applying similar approaches for proving CLTs in other (mean field) spin glass models. 



Specializing Theorem 1.6 to linear functionals of X^, we may apply the Stein's method 
machinery. 

Corollary 1.7 (quenched average Multivariate CLT) Let w G R^" be fixed and suppose 
f E J-'. Let = w ■ X^^. Then we have 

Consequently, 

Wi{X^„ZaJ < CN-^'^ 

where 

a-o} = w ■ €-w. 

The proof of this corollary is analogous to that of Corollary |1.4| and is omitted from 
the paper. 

Next we reformulate Theorem 1.6 so as to obtain a quenched CLT for the energy den- 



sity of the SK model. By Theorem 1.6 



2 

*3 M^oo 



\im V {{Hn - {nN)f) (1.18) 



al = l-ql + 2^q2iq3 - qi) - l^qi ( [I - ■ ff 



1,3 

1 ^IK 



exists. Moreover, it may be given explicitly by 

- 2{li%{l - q2) + 15' {q3 - qiqi) - 2^1) [[1 " P'^V " ^'"j^ 3 (1-19) 

where = w^'^' ■ (1, -1,0,0) and t^^, = w^'^' ■ (0,0, 1,-1) and the (2) vectors are 
given explicitly: For 1 < < /c' < 4 and 1 < r < 4, let A {k, k',r), B {k, k', r) be defined by 

Aik,k',r):=Vo((£h''' -q2 
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B{Kk',r) 



and 

j6fl \{k = r ork' = r 
otherwise. For each pair {k, A:'}, we denote by w^^^^^i G E^" the vector 
w^,r ■■= {B{Kk'A),B{Kk',2),A{Kk'A),A{Kk',2),). 

Corollary 1.8 Suppose that {^,h) satisfies the conditions ofTheorem \1.6\ Then there exists a 
deterministic variance Oq so that 



E 



((7^n-(Wn))') 



Moreover, for any function f so that f,f' S JF, we have 



^{{n^f{n^)-cry'{n^)-{n^)f{n^)f) < (||/||^ + cn 



-1/2 



2. Preliminaries 

We begin with two basic facts which will be used often below. The key lemma, proved 
in im, is as follows. 

Lemma 2.1 (Proposition 2.5.3 from HH) Suppose j6o satisfies the high temperature condition 
( |L4| . Let ^ < j6o- Then for any n e N, there is a K{n) > such that for all / : ^ R, 

\v{f)-vo{f)\<^v{f'y (2.1) 

\yif)-yo{f)-v'oif)\<^Hfr- (2-2) 

Here Vq denotes the derivative of Vt with repsect to t evaluated at t = 0. Introducing 
the notation [m] = {!,■ ■ ■ ,m} C N, a direct calculation produces an expression for 
v'oif) (seep. 77 from HI): 

y'o{f) = [i' E ^0 (eV - ^2) /) 

i<e<e'<n 

l<(<n 

+ fi'"-^yo {e"^'e"^' (r-,,„,2 - ^2) /) . (2.3) 

This expression motivates the following general estimate obtained from the cavity 
method. 

Lemma 2.2 Let S be a fixed finite subset o/N and p be a fixed integer. Let rj : [p] ^ N be an 
injective function. Suppose that n is large enough so that f] {[p]) C [n]. Then if f^ : T,'}^ -^ — > 
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R, Tve have 



V 



\ / / i<e<e'<p 

+ i^P - W^) E ^ ir i^W^c - ^2) ) 

^'GW\'7([P]) 
1<1<P 

{W'}cH\7(1p1) 

- {qp - qpqi) E ^ ir {^m,n+i - ^2] 

i<e<p 

- ^^n{qp+2-qpq2) E ^ {r{R{,n+i - qi)) 

ieln]\^ilp]) 

+ - qpqi) V if- (Rn+i,n+2 - ^2)) + V {{f-f) ^ O (i) 

w/zere O (^) denotes an expression hounded by CN^^. 

We relegate a proof of this statement to Section |6] It is a direct consequence of ( |1.4| |, 



12.311 and Lemma 2.1 



The key points here are the expression of the righthand side in terms of v and not 
Vq and the fact that the error is of order 1/N, which is important when considering the 
scaled overlaps Tie/'. 

Let V" = (^1,...',^") and let 

Vr = V"-(0,...,?':...,0). 

Further, for each F : IR^" R let f (V) = F(Vf ). In the next result we denote Vf (V) 
the gradient of F evaluated at V and let V^f denote its Hessian. 
We let 1Z denote the ("2^)-tuple overlaps 

Tl = {Tl\,l, • • • /'^l,f!+2/ • • • ,'Tin+l,n+l) 

lexicographically ordered so that [i,]) < {k,£) if i < k or if i = k and ; < £. If 

1 = (1, . . . , 1) G RC'J ) let at = (^['■')i<r<,.'<„ := «cr[')i<r</-'<n - qi'i- denote the (lexico- 
graphically ordered) replica vector of spins evaluated on the z'th vertex. 

Recall the definition of the matrix 2t from ( 1.14| |. The following is a simple, but crucial 
corollary of the previous lemma. 



Corollary 2.3 Suppose that the high temperature condition \IA\ holds. Suppose that F G 
C^(R^"). Then entry-wise, we have the following estimate: 

-I N 

V (f (V") [[Id - ■ 7^)) = —Y2v{VF{Vr) ■ (V" - Vf) +Rem (f ) (2.4) 
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where 

N 

N 



Rem (F) = ^ ((^*'' " ^) ' ^ 
1 



! = 1 



N 



+ ii^" - H") ■ (V^F(Vo,,) ■ (V" - VD) a,] 




wzY/j Vo,i = AoV" + (1 - Ao) Vf for some (random) Aq = Ao( V", V,") G [0, 1 



Remark 4. There are two points worth making: First, most functions F we are interested 
in depend very weakly on any given site z; one should think in the simplest case of 
F((7^) = G [Ailj). The advantage of the above formulation, which we shall not pursue, 
is that one may consider functions like F [a) := f {u -a^) for any u G S'^^^ such that all 
coordinates of u are 'small' in an appropriate sense. Of course, Rem{F) will be seen to 
be 0(-^) in situations considered below. 

Second, notice that the first term on the right hand side of ( |2.4| the argument V" 
does not depend on the f'th vertex, which means we may apply the first estimate from 
to obtain expressions in terms of i/( VF(V")). The calculations then 'close' by 



2.1 



Lemma 

applying Taylor's theorem to express i/(VF(V")) as v(VF(V")) plus some error. This 
sets up the functional identities we are after. 



3. The quenched average CLT for the Internal Energy 



Throughout this section we work under the hypotheses of Theorem 1.2 Assume for 
now that / G Let us begin with an elementary calculation using Gaussian integration 
by parts: 

V {£Nf {£n)) = \y if {£n)) - ( [Rh - 4] f i£N)) + o ^ "^"^ 



N 

It is now natural to write Ri^2 = Ri,2 — Cj2 + ^2- Expanding in the above expression we 
have 



^v{[Rl,-4]f{£^)) 



M2V {ni,2f {£n)) - 



R 



1,2 



mff{£^) 



where 7?.i 2 denotes the centered, scaled overlap defined in Section |1.1[ Because of the 
high temperature assumption ( 1.4 1, we may bound the final summand by 



2VN 



. Hence 
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the goal of our analysis will be to identify a formula (up to order N^^^^) for 

(7^l,2/(^N)). 

Though we do not appeal explicitly to Corollary |2. 3} the next two lemmas essentially 
re-derive that result in explicit form. Recall the constants a, b, c defined above Theorem 
11.21 We state our first lemma. 

Lemma 3.1 We have the identity 

v{{i-^h)ni,2f{£N)) = -^^bv{n2,3f{SN)) + M2av{f{SN)) + "^"^ 

Proof. Using symmetry, we have 



V (^i,2/(^n)) = v^Vn i^eh^ - q2) f {Sn)) • (3.1) 
We decouple the argument of / from the last spin variable by writing 

An easy calculation shows that v < C for some constant C > independent 

of N thus we may use the Taylor expansion to linearize / around Sj^. We obtain the 
expression 



+ V [[eh^ - ^2) e'W' (^n)) + O (^) • (3.2) 

Note that does not involve replicas of spins associated to the N"" site, nor does it 
involve the disorder associated to the N^'^ site so that the interpolation employed in the 



cavity method does not affect this quantity. First we have, by Lemmas |2 . 1 1 and 2.2 

-[i^2 {qi-ql)v{n2,,f{£^)) 



+ ^^3 (^4-^i)^/(7^3,4/ {£n))+o 

= fiHi- q2fv{n,,2f {£^)) - fi'bv (7^2,3/ {£^)) +0 

In the last step we used replica symmetry along with the fact that £^ only depends on 
the first replica to combine summands. Since v ( TZ^ 2 ) ^ C and v < C, we apply 
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the Taylor expansion and Lemmas 2.1 and 2.2 again to obtain 

V (Vn (eh' - q2) f {£, 



fi' (1 - V (7^l,2/ (^m)) - ^''hv (7^2,3/ (^n)) + O j • (3-3) 

For the remaining term from ( |3.2| | we have (using Gaussian integration by parts) 

N / , , / 2 ' 



N) 



/=2 

We apply Lemma |2.1} the Taylor expansion, and symmetry to obtain 

eh' - ^2) ehy {S^)) = /5 (1 - q2fy{Ri,2f {£n)) + ||/||^ ^ 



= /3<j2(i-^2)'t/(/'(£:^,)) + ||/||^-^ 

The last line here follows from the assumption that we are in the high temperature re- 
gion. 

Combining the various terms, we have shown that 

C 



N 

□ 



t/ ((1 - ^'a) 7^l,2/(fN)) = -r&t/ (7^2,3/(fM)) + Miav {/'{Sn)) + \\f\W 

A nearly identical argument allows us to treat the term involving 7^2,3 ^ 
Lemma 3.2 We have the estimate 

v{n2,3f{£N)) = fi^bv (7^l,2/(fN)) +l6'c^/(7^2,3/(^M)) 

+ ^q2bv{f{£^)) + \\f\\:f^. 



The above pair of lemmata give us a nontrivial system of equations allowing the so- 
lution of V (7?.i,2/(^n)) in terms of v {/'{Ejsi)): 

Corollary 3.3 We have 

[\ - fi'a){l - ^h) + ^%') V {n^,2f{£f^)) = 



^^2 {a-f(h'^ac))v[j\En))^mT 



16 
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Proof. This is a s traig htforward manipulation using Lemmas 3.1 and 3.2 
Proof of Corollary 



1.4 



□ 

To translate Lemma 1.3 to a Gaussian with variance cr^, let ^(x) = 



o'g*{^) and f{x) = f*{ax), where /* solves the ordinary differential equation ( |1.11| | for 
g*. Then 

<T^f'{x)-xf'{x)=g{x)-ng{az)] 
where z is a standard Gaussian variable. Hence the bounds of Lemma [Oj become 

,\\f\u<\[lau \\r\ 



< u 



where L = Lip{g) = Lip{g*). 

Now let us fix ^ : R ^ K so that Lip{g) < 1 and consider 

\v{giSN))-lE[g{az)]\ 

If / solves then 

\vigi£N))-E[gicrz)]\ = \vi£^fi£r,))-aMf'i£N))\. 



(3.4) 



(3.5) 



(3.6) 



(3.7) 



By Theorem 1.2 the right hand side is bounded by C||/||;rN 2. This estimate in turn is 
bounded by CN^^ from the considerations of the previous paragraph. Optimizing over 
g gives the result. □ 



4. The Quenched CLT for the Energy Density 

In this section we shall outline the more complex Theorem 1.6 and Corollary [L8] which 
rely on elaborations of the ideas from the previous section. We will postpone the proofs 
of some of the technical statements to Section|6j in favor of giving a detailed sketch. Most 
of the lemmata left unproven in this section are computationally intensive and obscure 
the main idea. 

Our first goal is to derive approximate identities for the expressions on the left hand 
side of ( 1.16| l with errors given in terms of the moments of || A"" || 2 under v and L~ norms 
of F and its derivatives. The first idea is to reduce their calculation to the calculation of 
the collection {v [KryGF {X"))}r,r'<„+2- Let Vi G R^" be defined by 

^1 ■= 2 (1/^2/- • •/'ji/O/- • -/O) ( " zeros) 

V2 := j6(^2 (0, . . . , 0, -qi{l- qi), qi + qiqi - Iqs, ...,qi+ qiqi - Iq^) ( n zeros) 

^3 := 2 (l/^?2/- • •/'ji/O/- • -/O) ( " zeros). 

Next let 71 denote the cyclic permutation (1 2 . . . n) and let tt © tt denote the product of 
cycles (1 2...n)(n + 1...2n). We let n and n® n act naturally on the above vectors by 
permuting coordinates, defining 

:= (tt© tt)'"^ • vi 
m' := (tt© tt)'"^ {^2 + ^3) 



CLTS FOR THE SK MODEL 



17 



Further, let r"' e rC'^') 



— *^ 

^k,k' 



'liik = l, k' <n 
-niik = l, k' = n + l 
otherwise 



and 



'k,k' 



'qi{l-qi) \ik = l,k'<n 
—nqi{l — qz) if k = 1, k' = n + 1 
qs — qiqi if l < k < n, k' < n 
— n((j3 — qiqi) if 1 < k < n, k' = n + 1 
C+'){q3 -qiqi) if k = n + h k' = n + 2 
^0 otherwise. 

Finally, we let 1Z denote the ("2 ^)-tuple of lexicographically ordered overlaps 

{7^1,2, • • • / Tll,n+2, • • • / T^n+l,n+2) ■ 



Lemma 4.1 Suppose that the high temperature condition \1A) holds. Then we have the follow- 
ing identities: 



v{£^GF{X'')) = V (el ■ V (GF)) + ^qiv (? ■ Hgf) + Er{F,G) 



and 



V (tW^GF (A"")) = 1/ (ml ■ V (GF)) + ^^v (r"' ■ Hgf) + £r(F, G) 



(4.1) 
(4.2) 



The proof of Lemma [41] is left to Section|6j 

This lemma suggests that we should study the interaction between the overlaps and 
the function GF{X"). This is accomplished in the next lemma, which can be seen as the 
main point of the paper. Namely, the behavior of the fluctuations of macroscopic quan- 
tities in the SK model are controlled by their interactions with the overlaps. Moreover, 
these interactions are computable through the derivation of an implicit set of equations. 
This should not be too surprising, however we believe that this technique provides a 
useful general tool for proving CLTs for the high temperature phase of mean field disor- 
dered systems and thus deserves special attention. 

¥orl<k<k' < n + 2', let A{k,k',r), B{k,k',r)he defined by 



and 



A{k,k',r) := vq 
B{k,k',r) : 



^2 £ 



jiqib if k,k'^r 
f^a ifk = rork' = r 
otherwise. For each pair {k, k'}, we denote by wjt,*:' £ IR^" the vector 

Wk,k' := {B{k,k',l),...,B [k, k', n),A{k, k',1),..., A{k, k',n), ) . 
Let V denote the vector of first order differential operators V := {wk,k' " V)i<)c<ic'<f!+2- 
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Recall the definition of the matrix 21 from Section [L2l 



Lemma 4.2 Suppose that the high temperature condition ( |1.4| | holds. Then entry-wise, we have 
the following identity: 



GF{A:") {Id- ^^^) - TZj = v{V{GF){A:")) + Er{F,G). (4.3) 
The proof of Lemma |4!2| is left to Section[6j 



The question immediately arises as to when the matrix Id — j6 2t is invertible. The con 



dition of invertibility, combined with Lemmas |4. 1 1 and 4.2 allows us to obtain Theorem 



Proof of Theorem 1.6 From Lemma [42) we have 

^/(7^Gf(A'")) = {Id - ^^^^y^ ■ v{V{GF){A:")) + Er{F,G). 

Plugging this identity into the righthand side of equations ( |4.1| | and ( |4.2| l we obtain the 
existence of a pair of vectors e, m G R^" so that 

v{£^GF{X'')) = e ■ V (V (GF)) + Er{F, G) 

and 

V (m^GF{X")) = m ■ V ( V (GF)) + Er(F, G). 



Now from the symmetry of replicas under v, we have 

v{£'GF{X")) = e'-v (V (GF)) + Er{F, G) 

and 

V (m'GF{A:'')) =m'-v (V (GF)) + Er{F, G). 



where 



e := n'-h 
m' := n'^^m. 



The covariance operator claimed in the theorem is then given by 



ej if f < n 
mj""if f > n + 1. 



By choosing G to be one of the coordinate functions and F to be the constant function 
1, the above equations allow us to identify C with the limiting covariance of A!^ under 
V. □ 

Proof of Corollary [0| Let 

v[{nN-{'HN)f)=v{{K-nl,) (nh-n'^)). 

(T^j converges to a limit, which we denote by (Tq, with a rate 



'N 



Now from Theorem 
bounded by CN-^^^'. 



1.6 
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We claim that 



Indeed, using replicas 



E 



< 



C 



N 



(4.4) 



E 



{Hn — {Hn)) 
Hn 



h\ 



N 



2 



T-/4 
li-N 



H 



T-/4 



2 



(4.5) 



Now, under the quenched average measure v the collection {Hfj}^^^ are exchangeable 
and therefore Theorem |1 .6| allows us to approximate the expression by the correspond- 
ing moment of a collection {he}^_-^ of exchangeable Gaussians, up to an error of order 

v{{H\i)^)N^^ where all have mean 0, variance v{{Hl^)^) and the covariance 

between pairs is identically v(H\qH\^). Also, a straightforward calculation with Gauss- 
ian integration by parts shows that under ( |1.4[ |, v{{H\^)^) < C so that in fact this error 
is bounded by CN^^''-^. Finally, note that ( |4.5| vanishes if we insert {hi}^^-^ in place of 
{^N}f=i because of the exchangeability, which proves the claim. Since we observed in 

the first assertion of the corollary follows. 



the previous paragraph that \(r: 
We next show 



■2 ^ L 



Tv{{nNf)"^o{n-"\ 



E {{HNf^HN) - olf {Hn) - {Hn) /{Hn))^] = 
Using replicas once again, we have 

E [{Hn/ {Hn) - (t^^Hn) - {Hn) /{Hn))^] = 

V {{{Hi - Hl)f{H\,) - alf'{Hi)} {{H^ - K)f{Hl) - alf{Hl)}) . 
Via symmetry, 

V ({« - Hl)f (K) - ay'{H\,)} {{Hi - H%)f{H'N) - ^/'(Wi,)}) = 

V ({H'n - Hl)f{H],){Hl - H%)f{H'N)) + 4v {f{K)f{Hl] 



2alv({Hh-Hj,)f{Hlj)f'{H 



Let us apply Theorem 1.6 to the first term on the right hand side. Letting G{x) = x and 
F{x,y) = we have |(7^ — (TqI < CN^^^^ and 



V f « - Hl)f{H'N){Hl - H%)f{H 



alv ({Hi - Hl)f{K)f'{Hl)) + Er{x,F). 
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This leaves us with 

E [{n^f{nN)-alf'{n^) - {nN)f{n^)f] = 

{4^ {f'{K)nK)) -v[{nh- nl)f{n\,)f\nl)) } 

Iterating the previous argument yields 

E [{n^f{n^)-alf'{nN) - {nN)f{nN))^] = Er{x,F) + Er{hVF). 

□ 



5. Proof of TheoremII.51 



Proof of Theorem 1.5 (Tj). We apply Theorem |1.6| in the case n = 1 and for functions 

F{Sj,,Mn) := fiS^ + M^). 

With w = (1, 1) this gives 

v{nNf{nN)) = {wxzv)v {f'inN)) +c\\f\\:FN-'/^ 

where £ is the limiting quenched average covariance matrix for Ai^^ £n- We are thus in 
a position to directly apply Stein's Method. □ 

Proof of Theorem 1.5 (2|. This statement is a consequence of a more general principle, 
which may be of independent interest. 

Let us consider the following abstract setup: we are given a sequence of random vari- 
ables (X]v, }iN, o'n)n>i on a probability space (P, Q, and let {Tn)n>i be a sequence of 
sub-sigma fields of T such that for each N, /^jv and aj^ are measurable with respect to 
(in particular, we do not assume }In, Cn are deterministic. Let E'^ denote the conditional 
expectation given T^. 

For any / G C'^(R),let 

l/k:=ll/l|oo + ||/(^)||oo + --- + ||/«||oo, 

where /^""^ denotes the mth derivative of /. 

Lemma 5.1 Suppose that for some fixed integer k and positive real numbers a. and L, we 
have that for each N and each / G C*^(R), 

e(e^(4/'(Xn) - (Xn - ^N)f{XN))f < L\f\,N-r 

Suppose that for each 6 > 0, E(e^'^N) is uniformly bounded over N. Let t/jv be the condi- 
tional law of Xn given jFj^, and 7m be the Gaussian measure with mean f/w and variance 
CT-^. Then the random signed measure — 7^ converges to the zero measure in prob- 
ability as a random sequence on the space of finite signed measures with the metric of 
weak* convergence. 
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Nothing like the full power of Lemma 5.1 is required here. In fact, we know by ( |4.4| | 
that we may take 



?T = tJn := lim E 



{{HK-inK))') 



Thus the second statement of Theorem 1.5 follows immediately Lemma 5.1 combined 
with Corollary |1.8| and the fact that the weak* topology, when restricted to probability 
measures, is metrizable by p. 

Proof. Taking f{x) = e'^^ = cos tx + i sin tx, where i = we can apply the above 

inequality separately to the real and imaginary parts to get 

E(E^(t72zV*^~ - {Xm - ^N)e'^^'')f < 2{k + l)Lmax{l,\t\''}N^\ 
Define the random function 

(/)n(0 :=E^(e'*(^~-f'~)). 
Since f<N and (7^ are measurable with respect to and |ze'*''~| = 1, we have 
|E^(4zV^^~ - (Xn - HM)e''^~)| 
= |E~(4te''(^~-f'~) + /(Xn - 
= \c7jjtcpM{t) + (l>M\. 

Let ipN{i) ■■= e-'^y^/^. Then ^n(O) = tpN{0) = 1, and ip'j^{t) = -aljtxpNit). Thus, for all 
t >0, we have 



\(PN{t) - xpN{t)\ < / \<P'n{s) - xp'^{s)\ds 
Jo 

< / CrljS\(pN{s) - tpN{s)\ds + |cr^S^]v(s) + ^^(s) |ds. 

JO Jo 



Now fix t > 0, and let 



\crljS(j)Nis) + (p'j^{s)\ds. 



Also, let 17 (s) := \(pM{s) — i/?m(s)|. Then we see from the last inequality that for all s S 
[0,f], 

v{s) < A viu)du + B. 
Jo 

By the standard method of using the bound recursively, we get that for all s G [0, t], 



vis) < Be 



As 
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Combining the steps and using the Cauchy-Schwarz inequality, we get 

IE|(/'n(0 - V'n(OI < ^('^''~''/ |4s(^n(s) +</'N(s)|ds^ 

where C(f) is a constant depending only on t. This shows that 'E\(pj^{t) — tpN{t)\ 
as N — > 00 for every t > 0. The same result holds for i < as well. Since (pN{t) — 
^N{t) is the characteristic function of the signed measure vj^ — 7^, the proof can now be 
completed using standard 'subsequence-of-subsequence' arguments. □ 



Proof of Theorem 



1.5 



To prove this statement, we compute (pN{t) '■= E 



Theorem |1.5|(|lll and standard results on characteristic functions 



•By 



lim V ( 



On the other hand, the proof of Lemma 5.1 gives 

lim E \ (e'f(WN-(HN» 
N— »oo L 

Since 



V e 



JtHN 



E 



Jt{HN-{HN))\jf,it{HN) 



we obtain 



lim <^n(0 = e-('^i--Q)''/2. 



□ 



6. Proofs of Lemmata 



Proof of Lemma 2.2 Note that under the hypothesis of the lemma. 



0. 
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Using ^2.2\ , substituting from \2.3\ and using the decoupling property of Vq, 

\ / / {r,r'}C[p] 

+ i^P - Wl) E ^0 (/" {^~(r),r' - ) 

l<r<p 

+ {qp+2 - qpqi) E ^0 {r (^^(.),n+i - '^2) ) 

{r,r'}c[n]\,,{[p])=0 



l<r<p 

('?p+2 - qpqi) E ^0 (/" f^rTn+l - '?2 



r6[«]\^/([p]) 

N' 



+ - qpll) VO (/- (R„-+i,„+2 -12))+ VO ((/")') ^ 



Recalling that Rj.^,, = R)c,)c' — replace each instance of R^.^., by Rk^k' at the 

cost of an error of the form vq ((/")^) ^ CN-\ Applying ( |2J] |, using the Cauchy-Schwarz 
inequality and the high temperature condition ( |1.4| | to bound the error gives the result. 



□ 



Proof of Corollary [2J] We shall present the calculation only in the case of v {Tln+i,n+2F) ■ 
The identities for the remaining coordinates are straight forward adaptations. By defini- 
tion 

-1 N 

V {nn+l,n+2F) = ^ E H (^r+'<^' - ^2) F( V") 

Let us restrict attention to a single summand as each of the summands may be treated 
similarly. Using the mean value theorem to expand F around Vf up to its second order 
derivatives, we have 



+ V ( (a^^a^+^ - ^2) Vf (Vf) ■ (V - Vf)^ 

^2) (V" - vn ■ v2f(AoV" + (1 - Ao)vr)(v" - vn) 



1 
2 

where the constant Aq may be taken to depend measurably on V", V". 

Obviously, the interpolation scheme applies equally to any vertex i, so Lemma 2.2 
implies that 

crr'crr'-^2)F{Vn) = E C,-,r'v{n,-yF{Vr))+v{FHvr)rO{N~'). 

VN l<r<,-'<n+4 
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where 
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q4 - ^2 

,2 



c 



r,f 



if r,r' <n 

ifr <n,r' E {n + l,n + 2} 
ifr = n + l,r' = n + 2 
if r < n,r' = n-\- 3 
ifr G {n + l,n + 2},r' = n + 3 

-2 il^~l2) ifr = n + 3,r' = n + A. 

Because F depends only on the first n repHcas, we may use the exchangeability of 
replicas to rewrite this equation in terms of the overlaps from the first n + 2 replicas. We 
have (with the notation ( |1.14[ )) 



q2-q2 
l-ql 

-n{q4-ql) 
-n{qi-ql) 

(n+2)(n+3) , 



' qi]r{vf)] = 



E 



2i: 



n+l,n+2 



v{nr,r'F{vn) + v{F^{vnyo{N-'] 



l<r<r'<n+l 

Expressing v {nr,r'F{Vf)) = v (n,^y,F{V)) + v {n,yF{V[)) - v {TZryFiV")) and col- 
lecting terms finishes the proof. □ 



By Corollary 2.3 to prove Lemma 4.2 we have two tasks: compute derivatives and 
bound errors. We begin by isolating a series of preparatory calculations. Let us denote 
the local field for the N'th site and r'th replica by and let 

We first note that || ^||2 has finite moments of all orders. 

Lemma 6.1 Let fc G N be fixed. Then there exists a C{k) depending only on k so that 



Proof. The proof is by Gaussian integration by parts and induction on k. The reader may 
consult IHI for more details. □ 



Let us introduce 



1 ^ 



N 



Lemma 6.2 Suppose that the high temperature condition ( |1.4[ | holds. Let I G [2n] be fixed. 
Then we have 



V (^(£V - q2)e'd,XGF){X^'-)) = A{k,k' ,r)v{d,.{GF){X")) + Er{F,G). (6.1) 

Proof. This follows from a straightforward sequence of applications of ( |2.1| | and Taylor's 
Theorem. □ 
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Lemma 6.3 Suppose that the high temperature condition \1A\ holds. Let I G [2n] be fixed and 
suppose that r < n. Then we have 

V -^2)e''V.,(GF)(A'"'-)) = B{k,k^ ,r)v{d,iGF){X^')] + Er{F ,G). (6.2) 



Proof. We consider only the generic case \ < k < k' < n, k,k' ^ r. The remaining 
cases are easy adaptations of the main argument. The first step is to apply Gaussian 
integration by parts. Noting that X^'^ does not involve the disorder appearing in the 
local field under consideration. 



N-1 n 

E E ((^'^'' - ^2)eV;e^'<9.,(Gf jlA""' 

l<r'<n j=l 

N-1 n 

- " E - ^2)£''^V^+V;+i3,,(GF)(Af"'-)) . 

Rewriting in the language of overlaps we have 

!/((£¥' -^2)e''r^,3,,(GF) {X^'-) 

E ((£¥' - q2ye'R-,MGF){X-'-) 

l<r'<n 



- n/5v ^(eV - ^2)e'-e"+^R,7„+i3.,(GF)(A^"'- 
Successive applications of \2.\) and Taylor's theorem (cf. Section 3) give 

V [[eh^' -q2)e'e^d,, (Gf) (A'"-)) = /3^?2[2^2 + ^1 - 3^4]t/ (ax,(Gf 

+ Er{F,G). 

The extra factor of q2 in front comes from the replacement of the variables R/^ /f/ using 
assumption ( |1.4| | □ 



Proof of Lemma 4.2 Applying Corollary |2.3| to the function K[V) defined implicitly by 

K{V) := GF{X"), 

we must compute an expression for the first term on the righthand side. Note that 

a 



Thus, we may compute v yio'lcr^ — ^^2) VK(V") ■ (V" — V") j by directly applying Lem- 
mas 16.21 and 16.31 
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To bound the error given by Corollary 2.3 we use Taylor's Theorem and Holder's 
inequality along with ( 1.4 1 to obtain 

\Rem{K) \ < Er{F,G). 

□ 



Proof of Lemma 4.1 The first equation, ( |4.1[ |, follows from a calculation using integra- 
tion by parts. Indeed, we have 

\i<j J i<jl<r<n 



+ Ar3/2 L-i 
-"^ i<jl<r<n 



Using the language of overlaps, this simplifies to 



\i<J J l<r<n 



+ ^ E ^ i^lrGF) - n^v {RU.GF) + Er{F, G) 



l<r<n 



where R14 = 1. Let us expand each of the overlaps (excluding R14) using 
By \\A) and the Cauchy-Schwarz inequality we have 



2<r<n 

+ /S(?2 E v{T^i,rGF)-n^q2v{ni,n+iGF)+Er{F,G), 

2<r<n 

which proves the first statement. 

Let us consider next the term involving the scaled magnetization. By symmetry, 

V (m^G{X")F{A:")) = V (VN{e^ - qi)G{X")F{;Y") 
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We have 

l<r<n 

+ L v(U-qi)e^d..UGF){^''n)+Er{F,G). 

l<r<n 



Applying Lemma 2.1 and noting that the zeroth order term for the decoupled measure 
vanishes, 

V (yN{e' - gi)G(A'"'-)f (A""'-)) = 

v'o{Vn{^ - (?i)G(A'"'-)F(;f"'-)) + Er{F,G). 

Using symmetry. Lemma [Z2] gives 

v',[e'-q^)GiX"'-)FiX"'- 

/5V(l-'?2) E v{G{X"'-)F{X"'-)ni,r) 

2<r<n 
{,V'}C[„]\{1} 

- n^%{l - q2)v{G{X^'-)F{X^''-)ni,n+i) 
-nf{q^-qiq2) ^ ^/(G(A'"'-)F(A'"'-)7^,,„+l) 

2<r<n 

+ "^^^^p^^^q^ - qiq2)v{G{X-'-)F{X-'-)nn+i,n+i) +Er{F,G). 
An application of Taylor's theorem and the Cauchy-Schwarz inequality implies 



V, 



',{e^-q^)G{X"'-)F{X"'-)) = ^''q^{l-q2) ^ v(G(A'")f (;f")7^l,,) 

l<r<n 

+ fi\q3-qiq2) E v{G{X")F{X")n,.r') 

{r,r'}Qn]\{l} 

- n^%{l - q2)v{G{X")F{X")ni,n+i) 
-n^^{q3-q,q2) E t/(G(A'")f (A"')7^,,„+l) 

2<r<n 

+ "^"^iS'l^s - qiq2HG{X")F{X")nn+i,n+2) 

+ Er{F,G). 
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Next let us consider the terms given by the derivatives of GF. Arguments analogous 
to Lemmas |6.2| and 6.3 show that we have (using Lemma 2.1 and Taylor's Theorem) 

v({e'-q,)e'd,„^,{GF){A:"'-)) = (1 - ^?)t/ (ax„,,(GF)(A"')) + £r(f,G) 



and 

V f (el - ^i)£^9,„,,.(Gf )(A'"'-)) = (^2 - ql)y (a.„,,(Gf )(A'")) + Er{F,G) 



for r>2. 

The terms involving the local fields i]^, ■ ■ ■ may be computed using integration by 
parts. For each k S {1,. . . ,n}, we have (noting that A!"'^ does not involve the disorder 
appearing in the local fields under consideration) 



v[{e'-qi)e'el,d,,{GF){X"'- 

E E ^y(i^'-qi)e'^f^'<rJd,,{GF)iX-n) 

l<r<n j=l ^ 



" E ((^' - ^i)eV|e"+ic7^"+i9,,(GF)(A"''-)) . 



Rewriting in the language of overlaps we have 

v[{e'-q,)e%d,^{GF){X"'-)) = 

X: /3t/((ei-^i)£VR,-;,3.,(Gf)(A'"'-) 



l<r<n 



- n^v ((e^ - q,)eh-+^R,,^^,d,,{GF){X-'-)) ■ 
The usual applications of Lemma [zTj and Taylor's theorem give 

{e^-q^)eH%^{GF){X-'-))= ^q^{l - q2)v {R^,d,^{GF){X^)) 

2<r<n 

- n^qi{l - q2)v (Ri,„+i9.., {GF) (A"")) + Er{F, G) 

= -i6^i^2(l - qi)v (9,1 (GF) (A"")) + Er(F, G). 
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and 

V - qi)e''l%^ (Gf ) [X^'-)) = Mii^ " ^2)v {Ri,A,{GF){X")) + 

E /5(^3-^2^i)t/(R)cA.(GF)(^")) 

2<r<n 

- n/3(^3 - q2qi)y {Rk,n+id.,iGF)iX")) + Er(F, G) 

= /3^i^2(i-^2)t/(a.,(Gf)(A'")) 

- 2j6(?2('?3 - q2qi)v (a.,(Gf + £r(F, G) 

for each 2 < k < n. The second equality in each expression follows by replacing each 
overlap by q2 at the cost of a term of type Er{F,G) via ( |1.4[ |. Collecting terms gives the 
final expression. □ 
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